A Multilayer Neural Accelerator With Binary Activations Based on Phase-Change Memory
نویسندگان
چکیده
Novel in-memory computing circuits, based on arrays of emerging nonvolatile memories, such as the phase-change memory (PCM), can boost cutting-edge performances artificial intelligent applications. However, spread PCM-based circuits is currently hindered by lack a design framework enabling fast, efficient, and low-power neural networks. In this work, novel approach to conceptual technical integrated networks proposed. particular, relax power hunger complexity state-of-the-art solutions, we propose fully analog where analog-to-digital converter (ADC) replaced simple comparator. The building blocks accelerator are presented validated in Cadence Virtuoso. major nonidealities, PCM conductance variability, drift, IR drop, readout threshold, studied considering their impact accuracy.
منابع مشابه
Toward Computation and Memory Efficient Neural Network Acoustic Models with Binary Weights and Activations
Neural network acoustic models have significantly advanced state of the art speech recognition over the past few years. However, they are usually computationally expensive due to the large number of matrix-vector multiplications and nonlinearity operations. Neural network models also require significant amounts of memory for inference because of the large model size. For these two reasons, it i...
متن کاملNeural Network with Binary Activations for Efficient Neuromorphic Computing
In this paper, we proposed techniques to train and deploy a multi-layer neural network using softmax loss for binary activations to best capitalize on its energy efficiency. These techniques include using the gradient of tanh function to approximate gradient of discrete binary threshold function during the backpropagation of training, and using a stochastic multi-sampling approach to convert hi...
متن کاملStorage Capacity of a Multilayer Neural Network with Binary Weights
Statistical mechanics is applied to estimate the maximal capacity per weight (a3 of a two-layer feed-forward network with binary weights, functioning as a parity machine of the hidden units. For K 2 2 hidden units, the maximal theoretical capacity is achieved, a, = 1, and the average overlap between different solutions is zero. These results agree with the simulations. At finite temperature one...
متن کاملImprovement of thermal performance of a solar chimney based on a passive solar heating system with phase-change materials
Passive solar systems such as solar chimneys need solar radiation in order to work. Therefore, they cannot present stable natural ventilation when solar energy vanishes: to have a more robust and stable condition, solar energy should be stored during the day and released back during the night. Phase change materials can save additional thermal energy during the day and release it during the nig...
متن کاملImprovement of thermal performance of a solar chimney based on a passive solar heating system with phase-change materials
Passive solar systems such as solar chimneys need solar radiation in order to work. Therefore, they cannot present stable natural ventilation when solar energy vanishes: to have a more robust and stable condition, solar energy should be stored during the day and released back during the night. Phase change materials can save additional thermal energy during the day and release it during the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Electron Devices
سال: 2023
ISSN: ['0018-9383', '1557-9646']
DOI: https://doi.org/10.1109/ted.2022.3233292